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Abstract. A recurrent theme in functional analysis is the inter- 
play between the theory of positive definite functions, and their 
reproducing kernels, on the one hand, and Gaussian stochastic 
processes, on the other. This central theme is motivated by a host 
of applications, e.g., in mathematical physics, and in stochastic 
differential equations, and their use in financial models. In this pa- 
per, we show that, for three classes of cases in the correspondence, 
it is possible to obtain explicit formulas which are amenable to 
computations of the respective Gaussian stochastic processes. For 
achieving this, we first develop two functional analytic tools. They 
are: (i) an identification of a universal sample space f2 where we 
may realize the particular Gaussian processes in the correspon- 
dence; and (ii) a procedure for discretizing computations in Q. 
The three classes of processes we study are as follows: Processes 
associated with: (a) arbitrarily given sigma finite regular measures 
on a fixed Borel measure space; (b) with Hilbert spaces of sigma- 
functions; and (c) with systems of self-similar measures arising in 
the theory of iterated function systems. Even our results in (a) go 
beyond what has been obtained previously, in that earlier studies 
have focused on more narrow classes of measures, typically Borel 
measures on M™. In our last theorem (section 10), starting with a 
non-degenerate positive definite function K on some fixed set T, 
we show that there is a choice of a universal sample space f2, which 
can be realized as a boundary of (T, K) . Its boundary-theoretic 
properties are analyzed, and we point out their relevance to the 
study of electrical networks on countable infinite graphs. 
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1. Introduction 

We are considering three functional analytic questions arising at the 
crossroads of pure and applied probability theory. In different contexts 
of non-deterministic analysis, one needs mathematical representations 
of the set of all possible outcomes, called the sample space Q, of some 
experiment, for example involving random trials. This is easy enough 
in simple discrete models, for example in experiment with tossing coins. 
The sample space of each trial is the set {head, tail}, and more subtle 
models then involve Cartesian products. However in infinite models, 
and in most continuous models, a complete description of a sample 
space of outcomes and its subsets, events, presents subtle problems. In 
Brownian motion models, for example, Q may conveniently be taken 
to be a suitable space of continuous functions, sample paths. Now, 
to approach computations, one is faced with the use of simulations 
of suitable subsets in fl; e.g., Monte-Carlo simulations. For such ap- 
proaches, because of noise, of uncertainties, or limited information, it 
is often helpful to pick different mathematical realizations of the set Q: 
For example, a version of Q consisting of sample paths defined only on 
suitable subsets, as opposed to defined point-wise. This is often good 
enough as one is interested in particular functions on Q. Whichever 
choice is made, Q will naturally come equipped with a sigma- algebra, 
say JF, of subsets, and a probability measure P defined on # '. The 
-measurable functions are random variables, and systems of random 
variables are stochastic processes. The process is Gaussian if we can 
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choose the probability measure P such that the random variables mak- 
ing up the process are Gaussian, and in L 2 (P). 

With the use of the corresponding Gaussian densities, and covariance 
functions, one then computes quantities from the random variables; 
and the question of choice of Q can then often be avoided. Nonethe- 
less, for applications to stochastic integration, one is forced to be more 
precise with the choice of Q, and a number of functional analytic tools 
are available for the purpose. In the approach to this problem based 
on Gelfand-triples (see Section [3]), one may realize Q as a space of 
Schwartz-tempered distributions. However with this realization of Q, 
it is more difficult to make a direct connection to the initial model, and 
to set up suitable Monte-Carlo simulations. As a result, there is a need 
for discretizations. Several such discretizations will be presented here, 
and comparisons will be made. 

Our approach, in this general context, relies on our use of Gaussian 
Hilbert spaces, and of associated sequences of independent, identically 
distributed (i. i. d.) standard Gaussian N(0, l)-random variables. But 
this then further introduces a host of choices, and of these we identify 
one which is universal in a sense made precise in Sections [HE 

In this paper, we will focus on Gaussian stochastic processes, but we 
also offer applications of our results to certain random functions (Sec- 
tion [9]) which involve non-Gaussian distributions. Similarly, a host of 
simulation approaches involve non-Gaussian choices. 

The purpose of the paper is three-fold. First we study (i) a univer- 
sal choice of sample space for a family of L 2 Gaussian noise processes. 
While these processes have appeared in one form or the other in prior 
literature, the choice of sample spaces has not been studied in a way 
that facilitates comparisons. We index these Gaussian noise processes 
by the set of regular measures in some fixed measure space (M, &$) , with 
SB some given Borel sigma-algebra of subsets in M. Secondly we make 
precise (it) equivalence in this category of Gaussian noise processes, 
and we prove a uniqueness theorem, where uniqueness is specified by a 
specific measure isomorphism of the respective sample spaces. In our 
third result (in), given a fixed measure space (M,&), we identify a 
Hilbert space H , with the property that the Gaussian noise process 
indexed by H universal envelope of all the Gaussian noise processes 
from (ii). As applications we compute Gaussian noise processes as- 
sociated to Cantor measures, and more generally to iterated function 
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systems (IFS) measures, and to a family of reproducing kernel Hilbert 
spaces (RKHS). 

For readers not familiar with Gaussian processes, for the present pur- 
pose, the following are helpful: [31 El El HH1 [221 12SI [2H SSI SB] ; for infi- 
nite products and applications, see [33], [39], and [3], [7]. The universal 
Hilbert space from (iii) is used in a different context [IT | |22 | |28 | I3T [ 138] . 
For a small sample of recent applications, we cite [TBI ED EZ] For re- 
producing kernel Hilbert spaces, see, for example, [2J [33] . In the way 
of presentation, it will be convenient to begin with a quick review of 
infinite products, this much inspired by the pioneering paper [33] by 
Kakutani. 

2. Preliminaries 

Below we present a framework of Gaussian Hilbert spaces. These in 
turn play a crucial role in the study of positive semi-definite kernels, 
and their associated reproducing kernel Hilbert spaces, see Sections [U]- 
[TU1 In its most general form, the theory of Gaussian Hilbert spaces 
% is somewhat abstract, and it is therefore of interest, for particular 
cases of "H, to study natural decompositions into cyclic components 
in % which arise in applications, and admit computation. Hence we 
begin with those processes whose covariance function may be deter- 
mined by a fixed measure. Even this simpler case generalizes a host 
of Gaussian processes studied earlier with the use of Gelfand triples 
built over the standard Hilbert space L 2 (IR d , dx) , with dx denoting the 
Lebesgue measure, with the use of Laurent Schwartz theory of tem- 
pered distributions. Our present framework is not confined to the Eu- 
clidean case. Indeed, starting with any measure space M and a Borel 
sigma- algebra 38, we then show in Section [5] that the General Gaussian 
Hilbert space (Definition 12 .2 j) decomposes as an orthogonal sum where 
the corresponding cyclic subspaces are those generated by a family of 
sigma-finite measures on M. Indeed, in applications to measurement, 
in physics, and in statistics, it is often not possible to pin down a vari- 
able as a function of points in the underlying space M. As a result, 
it has proved useful to study processes indexed by sigma- algebras of 
subsets of M. 

In our consideration of random variables, of Hilbert spaces, and of 
Gaussian stochastic processes, it will be convenient for us to restrict 
to the case of real-valued functions and real Hilbert spaces. It will 
be helpful to first state the respective results in the real case, and 
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then, at the end, when needed, remove the restriction. One instance 
when complex Hilbert spaces are needed is the introduction of Fourier 
bases, i.e., orthogonal bases consisting of functions e A where Ael and 
e\(x) = e lXx or e 2mXx . However, our setting will be general measure 
spaces (M, 83, /x), where 83 is a sigma- algebra of measurable subsets 
of some set M, and // is a positive measure on M. The restricting 
assumption is sigma- finiteness, i.e., there are subsets Bi, B 2 , . . . of 8$ 
such that 

oo 

(2.1) M = (J Bj, and fi(Bj) < oo, Vj G N. 

3=1 

Definition 2.1. ^4 Gaussian (noise) stochastic process indexed by (M, 8$, jj) 

consists of a probability space (Q, J^", P): f2 is a set (sample space), 8P is 
a sigma- algebra of subsets (events) ofVt, and P is a probability measure 
defined on 8P . We assume that, for all A G 83 such that /i(A) < oo, 
there is a Gaussian random variable 

(2.2) W A = W ( / } : n — > R 

with zero mean and variance f-i(A) (that is, Wa ~ N(0, (J>(A)) , the 
Gaussian with zero mean and variance fi(A)), i.e. for all a,b G R U 
{±00} with a < b, 

{wGfl I a < W A {oo) < b} G 



and 



1 * 2 

P ({a < W A (u) < 6}) = / e'WTrfa; 

' y/2n 11(A) 



r KA) 1 _ii£ , 
2 ctx 



where 71 is £/ie standard Gaussian on R. 

Definition 2.2. ^4 Gaussian process indexed by a (fixed) Hilbert space 
H consists of a probability space (f2, J^,P) such that, for all F G %, 
there is a Gaussian random variable Wf with law N(0, \\F\\y) such that 

(2.3) E(W Fl W Fa ) = (F u F 2 ) H , VF x , F 2 G U. 

It is further assumed that for all {Aj} n . =l C 83 such that < fJ>(Aj) < 
oo, % = l,2,...,n 7 the joint distribution of the family is 
Gaussian with zero mean and covariance matrix (/x(A n A,-))™ - =1 . We 



will assume throughout that dim L 2 (/i) = oo. The finite dimensional 
case is dealt with separately. 

Remark 2.3. With the specifications in Definitions \KT\ and \2.2\ it is 

known that, in each case, such Gaussian processes exist. In the case 
of Definition \2.2\ when {Fj}" =1 is a system in H, then the random 
variables {W / i? i }™ =1 have a joint Gaussian distribution corresponding to 
the covariance matrix ((Fi, Fj)y)™j =1 - 

Starting with a measure space (M, 3§) , we will show in Section [5j that 
there is a universal Hilbert space % which contains all the stochastic 
processes derived from sigma-finite measures /i on (M, S3). In detail, 
given an arbitrary /i , we get a Gaussian process with \i as its 

covariance measure; see Definition 12.11 Now, the universal Hilbert 
space "H over (M, will satisfy the conditions in Definition 12. 2( and 
it will be a Hilbert space of sigma-functions (Definition 14. ip . Before 
getting to this, we must prepare the ground with some technical tools. 
This is the purpose of the next section on infinite products, and discrete 
Gelfand-triples. 

3. The probability space (fi s , J? s , Q) 

The purpose of this section is to show that there is a single infinite- 
product measure space such that for every measure space M and fixed 
Borel sigma-algebra everyone of the Gaussian processes where 
fi is sigma-finite measure on M, may be represented in L 2 of this 
infinite-product measure space. Since the construction must apply to 
every sigma-finite measure /i, we must adjust the construction so that 
it can be adapted to orthonormal bases (ONBs) in each of the cor- 
responding L 2 (/x) Hilbert spaces. To do this, we will be introducing 
a suitable Gelfand triple (see fl3.2p - fl3.3l) ). realized in sequence spaces, 
as opposed to the more traditional setting based instead on L 2 (R d , dx) 
and Schwartz tempered distributions. There is a number of advantages 
of this approach, for example we are not singling out any particular 
L 2 (/i), and also not a particular choice of ONB. 

An initial choice for Q$ is Qs = XfA that is the space of all functions 
from N into R, or equivalently, of all real sequences (ci, c 2 , . . .) indexed 
by N. Let s be the space of sequences c = (c„) ne N G x N R with the 
following property: For every p6N there exists K p < oo such that 

(3.1) \c J \<K p r p , VjGN, 

and denote by s' the dual space of all sequences £ = (^)ieN of poly- 
nomial growth, that is, such that there exists q E N and K q > such 
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that 

(3.2) (, < VjGN. 

Then (see 1231 ESI 031) 



scfcs' 

is a Gelfand triple, i.e., with the semi-norms defined from (13.ip . s be- 
comes a Frechet space, and the embedding from s into i 2 is nuclear 
(and s' denotes the dual of s). 

Let J^s denote the sigma-algebra of subsets in s' generated by the 
cylinder sets as follows: For ci, c 2 , . . . , c n G s and an open set Ocl n , 
define the cylinder Cyl (ci, . . . , c n , O) by 

(3.3) Cyl ( Cl , ...,c n ,0) = {£es'\ «£, Cl ), . . . , <£, c n )) G 0} . 

As the data in ( 13. 3ft varies, we get the cylinder sets in s' and the cor- 
responding sigma-algebra J^g. 

Further note that the sets in (13.31) generate a system of neighbor- 
hoods for the weak*-topology on s'. Moreover, if s is assigned its 
Frechet topology from the semi-norms in (13.11) . then s' (with its weak*- 
topology) is the dual of s. 

Lemma 3.1. From Gelfand's theory we therefore get the existence of 
a unique probability measure Q on (s', J^ s ) with the property that 

(3.4) ^e i ^ c) dQ(0 = e-^ 1 
where 

oo 

(3-5) (C'-> £c&, 

3 = 

and ||c||| = X^i c f- Moreover, (£, c) in (13 ,4p and ( 13. 5 p extends from 
s x s' to £ 2 x s' , representing every c a P 2 as a Gaussian variable on 
(s',#s,Q) ; mft 

(3-6) E Q ((-,c)) = 0, 

and 

(3-7) E Q ((-,c) 2 ) =||c||l. 

Furthermore, the set of coordinate functions on Q§ : s' ; 
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turns into an independent, identically distributed (i.i.d.) system of 
N(0, 1) standard Gaussian variables, and we get: 

(3.8) Efo rr,...^'"") = {-l) k ' 2 c h c j2 • • • c jk e~^l 
Proof: We begin with the assertion 

(3.9) E Q (n j7 i k ) = S jik , Vj, k E K 
Take first j = k; then, 

E Q (tt|) = -L f f e-idc, = 1, 

and if j ^ k we get 

1 r r cff+cg 

Eq (7T,7T fc ) = — CjC k e 2 dCidCjfc 



1 '• 2 



xe 2 fix 

V27T 

= o, 

which proves (13. 9p . 

We now prove the assertion (13.41) . With (I3.5P we get 

oo 

(6, c) = J2 W^)' v £ G s '' and Vc G s - 

We prove H3.4[) for c G s, and then extend it to all of £ 2 . We have 



J e^' c) dQ^) = E Q ( e <E*Li 

oo 

= J]E Q (e****W) 



fc=i 



n 

fe=i 



e 2 



-illrll 2 



which is the desired conclusion. 



The proof of (13. 8ft follows from an application of ( 13. 4ft to 

(3.10) c + tie^H htfce Jfc , ti, . . . , 4 G K, 

where 

(e^ Vj, fGN. 



is the standard ONB in £ 2 , i.e. ej = ti> Now (JH21 follows if (IXTUj) is 
substituted into (13 .4p . and the partial derivatives g|- • • • J^- are com- 
puted on both sides, and then evaluated at t\ = ■ ■ ■ = t k = 0. □ 



Lemma 3.2. Let Q = x N 7 X be the product measure. Then 

(3.11) Q(s') = 1 and Q(£ 2 ) = 0. 

Proof: The first claim follows from Minlos's theorem applied to the 
following positive definite function on s 

(3.12) cGs ^ e - ^. 

Indeed, the function (I3.12p is clearly continuous with respect to the 
semi-norms in s; see (13. ip . 

We need to prove the second claim in (13.111) . i.e. the assertion that 
C 2 C s' has Q-measure zero. Assume the contrary, i.e. assume Q(£ 2 ) > 
0. Since 

lim 7Tj = 

point- wise on £ 2 , we have 

lim / e i ^dQ(cu) = Q(f ) 

jr'-S>00 Jp 

as an application of Lebesgue's dominated convergence theorem. On 
the other hand, 

E Q (e^ ( - ) ) = e"5, VA;GN, 

and so another application of Lebesgue's dominated convergence theo- 
rem leads to 

e"3 =Q(f) + Q(s'\f), 
which is a contradiction since the sum should be equal to 1. □ 



Theorem 3.3. Let (M,&,/j.) be a sigma-finite measure space as spec- 
ified in Section \4\ and let {(fj}^ be a choice of orthonormal basis 

(ONB) in L 2 (/x). Then, the Gaussian process may be realized in 
L 2 (fi§, Q) as follows: For A 6 £$ such that < fi(A) < oo, set 

(3.13) W^\0 = p^j^ j (x)d»(x)^ j (0, £es'. 

Then, W^> , defined by (13. 13[) . is a copy of the Gaussian process from 
Definition \2.1\ 
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Proof: In view of (13.81) . we need only to prove that hi H3. 131) is 

a N(0,[i(A)) Gaussian variable, and that 



r -7, (■/•)(///( a;) J TT k 

ip k (x)dn(x) ) 5j, k 



(3.14) E Q {w { fw { ^\ = n(A nfi), VA, 5 e ^. 

But the first assertion follows from 

and we prove f !3.14p as follows: 

= (Xa, Xb)l2(^) 

= /i(A n 5), 

which is the desired conclusion. □ 
In the next section, we generalize the expansion formula ( 13 . 13[) above. 

Corollary 3.4. Let (M, 38) be as in Theorem \3.3\ let ft and A be 

two sigma-finite measures defined on it, such that << A ; and let 
f G L 2 (M, ^jC, //). Then, in the representation H3. 13[) . referring to 
L 2 (s', Q), we have 



(3.15) W^[fJ^-\=W^(f), Qa.e. 



Proof: Picking an ONB {(Pj}j eN in L 2 (M, /i), we note that then 

I <Pj\f&\ is an 0NB in L2 ( M ' A )- Now use fl ^T3|) for the pair 
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of ONBs. We get 

oo 



Y] ( / ( Pj(x)f(x)d^i( 
f^(^J^ j {x)f{x) d ^{x)d\{ 



X) ) 7Tj 

X) ) Tlj 



J 

oo 



□ 



We need another construction of a universal space as well, using a 
construction of Kakutani [HI]. More precisely, consider the space x^R, 
and denote by £ a running element in this cartesian product. Define for 
-^(0 = /n(£i> • • • j where / n is a measurable and summable function 
of n real variables 

= / ' ' • / / n (fl, • • • , Cn)7n(Cl, • • • , fn)^ 1 ' ' ' ^£n, 

where 7 n is the product of the densities of n i.i.d. N(0, 1) variables. 
By Kolmogorov's theorem [40J, there exists a unique probability Qk 
on E such that 



7i 



In fact, 



(3.16) Qk = H 



on the countably infinite Cartesian product Yin ^ where 71 is the stan- 
dard iV(0, 1) Gaussian on R (with density ~75= e ~~)- 



The measure Qk and Q have the same characteristic function, and 
Qk( s ') — 1- So we will in the sequel use both the spaces (s',^ s ,Q) 
and(n N K,Q^). 
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4. A HlLBERT SPACE OF SIGMA-FUNCTIONS 



In spectral theory, in representation theory (see e.g. [HI EH]), and in 
the study of infinite products [22J, and of iterated function systems 
(IFS) (see e.g. [26]) one is faced with the problem of identifying direct 
integral decompositions. Naturally, a given practical problem may not 
by itself entail a Hilbert space, and, as a result, one must be built by use 
of the inherent geometric features of the problem. In these applications 
it has proved useful to build the Hilbert space from a set of equivalence 
classes. The starting point will be pairs (/, /x) where \i is a measure, and 
/ is a function, assumed in L 2 (/x). It turns out (see [SB]) that the set of 
such equivalence classes acquire the structure of a Hilbert space, called 
a sigma-Hilbert space. Further we show through applications (Sections 
[7| and [8]) that these sigma-Hilbert spaces form a versatile tool in the 
study of Gaussian processes. These Gaussian processes are indexed by 
a choice of a suitable sigma- algebras of subsets of M. 

Definition 4.1. Let (M, 8$) be a fixed measure space, and let M{M, 8§) 
denote the set of all sigma-finite positive measures on (M,8S). For 
pairs (fi,fj,i), i = 1,2, where 



(4.1) meJr{M,&), /,gL 2 (/x 



2 '- 



we introduce the equivalence relation ~ as follows: (/i,/xi) ~ (A, ^2) 
if and only if there exists A G ^#(M, 8$) such that \Xi << A and 



Here, ^ denote the respective Radon-Nikodym derivatives. For the 
measure X, we may take X = fix + A*2- 

It is known (see [38J ) , that ( 14. 2ft indeed defines an equivalence relation 
in the set of all pairs as specified in (I4.ip . If /x G ^(M,8$) and 
/ G L 2 (/x), we denote the equivalence class of (/, n) by fy/djl. Moreover 
(see [38]), set 



(4.3) (/ lV ^, hVdi^) = J fi (x) h (x) (x) ^ (x) dX (x) , 

where A is chosen such that /Xj << A for z = 1, 2 (for example, one can 

take A = /xi + /x 2 ) and set 

(4.4) 

/1 + /2 \fd4M1 = equivalence class of (fx \J~j^ + h v/^, A) . 
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The operations defined in ( 14. 3 p and (14. 4p are known to respect the 
equivalence relation ( |4.2p . The set of all corresponding equivalence 
classes becomes a Hilbert space, which we shall denote W = T-L(M, 
A separate argument is needed in proving completeness, see [38]: If 
{fnVd^njneN is a Cauchy sequence in H(M,£$), there is a pair (/,//) 
with associated equivalence class fy/d/1 such that 

lim \\fy/dfj,- fnVdjj^\\-H(M,m) = 0. 
n— too 

Proposition 4.2. The Gaussian processes from Definition \2.1\ with 
(M, n) given, are special cases of the one from Definition \2.2\ if we 
take H = L 2 (/x). 

Proof: To see this, fix (M, /i), and let be the associated Gauss- 
ian process. Then the map 

(4.5) AeJ, fi(A) <oo =>• W { f GL 2 (fi,P) 
extends to all of L 2 (/i). The extended map, denoted by 

(4.6) W^(f)= [ f(x)dWM, 

J M 

and with range in L 2 (fi,P), is the Ito integral [22J. When / G L 2 (/i) is 
a simple function, that is a finite sum of the form 

N 

(4-7) f = Y^a iXAt , 

i=l 

where the Oj are real numbers, and the belong to SS are such that 
Ai fl Aj = for i 7^ j, then set 

N 

(4.8) W^{f)=Y,^ W< £- 

i=l 

Using 

(4.9) ^{Wfw^) = fi(A nfl), VTL, B G ^, 



we get 



N 

(4.10) E(|^)(/)| 2 )=^a 2 M^)= / 

i=i Jm 



' f(x) 2 d»(x). 



(In the complex case, we use f M |/(x)| 2 (i/i(x) on the right hand-side of 
(I4.10p ). Since every function / G L 2 (/x) is the limit (in the norm of 
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L 2 (/x)) of a sequence of simple functions, we conclude that the isometry 
(14,1 Op extends to all of L 2 (/i). Furthermore, by polarization, 

(4.11) E(wM(f)wM(g)) = (f,g)„ w V/,<? G L 2 (/i). 

□ 



Lemma 4.3. Consider \M,B&) as in Definition \4-l\ and let 

i = 1,2 fre a j>azr ; see (14.11) . Then, 

(4.12) 

~ (/ 2 ,^) <=► ^ (Ml) (/i) = ^ 2) (/ 2 ), Qa.e. 

Proof: We first assume that ~ (fejfa)- There exists A G 

^#(M, ^) such that both /ii and /x 2 are absolutely continuous with 
respect to A and such that (14.21) is in force. Then, 



(4.13) 



rfA 

g?// 2 
dA~ 



which is the desired identity on the right hand-side of (I4.12p . For the 
justification of (I4.13p . see Section [3j especially Corollary 13.41 

Conversely, assume that W^ x \f\) = W^ 2 )(/ 2 ) (almost everywhere 
with respect to Q) for some pairs (/i, /ii) and (/ 2 , /x 2 ). By the argument 
above applied to A = \i\ + /i 2 , we get 



(4-14) WW (f^)= WW (h\f 
Hence, for every tp G L 2 (A) we have 

( 



M 



dfi 2 
~d\ 



h{x)\l d ^{x)\d\{x) 



\ 
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as follows from (I4.14p . Since this holds for all ip G L 2 (A) we conclude 
that 

that is ~ (/2,A*2)- n 



5. The first main theorem 

Starting with a measure space M and a Borel sigma-algebra we get 
for every sigma-finite measure \x on M an associated Gaussian process 
W^M . Now, for every function / G L 2 (/i), we may therefore compute 
an associated Ito-integral of / with respect to this Gaussian process 
W^; see Proposition 14.21 We denote this Ito-integral by W^\f). We 
proved in Section 0] that, when / and \i are given, then the Gaussian 
random variable W^(f) depends only on the equivalence class of the 
pair (f,fi). As a result we are able to show (Theorem 15.31) that all the 
Gaussian processes W^' merge together (via a sigma-Hilbert space) to 
yield a single Gaussian Hilbert space in the sense of Definition 12.21 

Definition 5.1. Let {M,S§) be fixed, and let M' denote the corre- 



sponding Hilbert space of sigma- functions; see Definition 4-1 For 
fj, G (M, 3§) we set 

(5.1) %) = {/v^|/a 2 w}, 

and 

(5.2) KM = [fy/dii | / G L 2 (a», |/| < 1 y, a.e.} , 
Lemma 5.2. Let /x G M.(M, 8$) be fixed. Then the map 

(5.3) Tf = fy/djl 

defines an isometrically isomorphic from L 2 (M, /i) onto 'H(y) 

Proof: It follows from Definition 14.11 that T is isometric. We claim 
that it is onto. Indeed, a pair (g, v) is in %(n) if and only if A = y + v 
satisfies 




(5.4) ^/_ = /v /_ a.e. A. 

We claim that 



(5.5) T*(g,v) = f, 
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where / is as in ( 15. 4p . Indeed, for all <p G L 2 (/i) we have 



= J <p(x)f(x)-J^(x)d\(x) 
ip(x)f{x)dn{x), 

' M 

and so T*(g,is) = f as claimed, and TT* = Id^( M ). □ 



Theorem 5.3. LefH be the sigma-Hilbert space of ' Definition ^. 1\ Let 
(M, £$) be as in Section [B Then, the map 



(5.6) f^/dil — > W^{f), 

defined for every \i G ^#(M, £3) and f G L 2 (dfi), extends to an isome- 

try F i — y W(F) from H into L 2 (Q S ,Q). Furthermore, < W(F) > is 

I J Few. 

a Gaussian %-process in the sense of Definition s.^, i.e., 

(5.7) E Q (W(F 1 )W(F 2 )) = F 2 ) H , VF 1; F 2 G Jf. 
Proof: Suppose that Fj = fi^dfii, i = 1, 2. Then, defining 

W{F i ) = W^\f i ), £ = 1,2, 
(see (15.61) ). identity (15. 7p holds. Indeed, 

E Q (wiFjWiF^ = E Q (W^\h)W^\f 2 )) 



/i (») /2 (x) y ^ (x) ^ (ar) d\ (x) 
= (Fi,F 2 ) n , 

where, in the last step, we used (I4.3[) in the definition of the inner 
product in "H. 
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We now turn to the linearity of W. For the sum in TL we have equation 
( Oj) . Hence, 

= W{F 1 ) + W{F 2 ). 

It remains to prove that W(-) satisfies the joint Gaussian property 
stated in Remark 12.31 We must prove that if F{ = fi\fdjli, i = 
1,2, ... ,n, then the joint distribution of 

(W(F 1 ),W{F 2 ),...,W{F n )) 

is the Gaussian random variable in ~R n with zero mean and covari- 
ance matrix ((F i: Fj)n)™. v To see this, pick A G ^(M,33) such 
that fix, Hi, . . . , //„ are all absolutely continuous with respect to A (for 
instance, A = ^ILi/-^)- Then, in view of f)4.3p . 

(5.8) (Fi, Fj) n = jj i {x)f j {x)^{x) d -^{x)d\{x). 
But, 

E Q (WiF^WiF^ = E Q (W^\n)W^\f 3 )) 

~ { H rfA )L2(A) ' 

which is equal to the right hand-side of (I5.8p . and leads to the desired 
conclusion. □ 

We conclude this section with: 

Proposition 5.4. / G %i(/z) if and only if f is the correlation function 
for two copies of W^' . 

Proof: One direction is clear. Let W[ and W 2 ^e two correlated 
copies of WW and set 

u{A)=^((W 1 t\w 2 t ) ). 
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v is a signed measure, defining the correlation between the two copies 
of IfW, By a Cauchy-Schwarz inequality, v is absolutely continuous 
with respect to fi. One then checks that the Radon-Nikodym / belongs 
to Conversely, given / e it suffices to define a signed 

measure by 

= / f(x)dfi(x) 

J A 

to define two correlated copies of W^ p \ 

□ 



6. Representation of in an arbitrary probability 

space (O, &,P) 

In this section we prove that the infinite-product measure space (The- 
orem [3]3]) is universal in the sense that every measure space (O, P) 
which carries some Gaussian processes i.e., makes into an L 2 
Gaussian process, can be computed directly from the universal infinite- 
product measure space. This is spelled out in Theorems 16.11 in this 
section and in Theorem 17.11 in the next section. 

In the previous section we have established a decomposition of the 
Gaussian process as an expansion in a system of i.i.d. N(0, 1) 

random variables. As before (M, 38, fi) is a given sigma-finite measure 
space. 

Theorem 6.1. Let W^> be represented in a probability space L 2 (f2, P) ; 
see Definition HQ] and let {<£j}„- eN be an orthonormal basis in L 2 (//). 
Then, there is a system {Zj} . gN of i.i.d. N(0, 1) random variables such 
that 

(6.1) =£(J A ^t)Mt)) ZA-) 

holds almost everywhere on Q with respect to P. 

Proof: Assume that A e 38 and < fi(A) < oo. We proceed in a 
number of steps. 

STEP 1: The system {Zj}. en 

(6.2) Zj = = [ ip j (x)dW^ ) (as an Ito integral) 
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is a family of i.i.d. N(0, 1) variables. 

To see this, we use the construction in Proposition 14.21 Indeed, 

E(ZjZ k ) =E(wM(< Pj )WM(<p k )) 

= 5 jik , Vj, k e N, 

are the desired orthogonality condition. The rest of the assertion is 
clear. 

STEP 2: We show that the sum on the right-hand-side of (16.21) con- 
verges in the norm of~L 2 (Q, JP, P) and 



„ 2 =E (\W^ 



- 2 E E (w^Z,) + 

oo „ 

, = 1 jA 



x)\< 

CO p 

x)p 



J 

H(A) - WxaWIpm 
n{A) - fj,(A) = 0. 



□ 



Corollary 6.2. Consider the space (M,3§,fi) as in the previous theo- 
rem, and let WW be represented in some probability space L 2 (fi, J^, P). 
Then, some point Xo G M is an atom, i.e. /i({x }) > ; where {x } de- 
notes the singleton, if and only if the ONB {{pj}j eN in L 2 (yu) has ip(xo) 
well defined, the expansion (16.21) contains a term 



(6.3) /i({x })^^({x })^, 

i=i 
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and 



oo 

(6 ' 4) X>^>> 2 = ^ 

Proof: Functions / G L 2 (/i) are determined only point- wise a.e with 
respect to /x, but if fi({x }) > 0, the functions / are necessarily well 
defined at the point x , i.e., f(x ) is a uniquely defined finite number. 
We apply this to the functions (fj in the L 2 (/i)-ONB from (16.21) . Hence, 
the contributions to the two sides in (16. 2p corresponding to A = {x } G 
38 are as follows: 

oo 

(6.5) < } (-) = MN})E^(N})^() 

3=1 

Taking norms in L 2 (Q, jF, P) we get 

Mfao}) = 0({^o})) 2 if(xo)) 2 , 
and the desired conclusion f)6.4p follows. □ 



Remark 6.3. Some care must be exercised in asssigning the random 
variable V/f 1 to sets A G 38 with fi(A) = 0, or /j,(A) = oo: If fi(A) = 0, 
we may take Wj£ to have law the Dirac distribution 5q on IR at x = 0. 
In view of (16.11) one may alternatively set = if fi(A) = 0. 

There are two conventions for dealing with the random variable 
when fi(A) = oo. One involves a renormalization, somewhat subtle. 
For other purposes, if n{A) = oo, we may simply take the random 
variable to have the uniform distribution. 



We now explain the connections between the present construction and 
the processes we built in [HIE]- 

Application 6.4. Let 5? denote the Schwartz space of smooth func- 
tions on R with its Frechet topology and let fi be a Borel measure on R 
such that J R (0jTjp < oo for some p G No (where No = NU {0} ). Then: 
(i) The function F: 

F(ip) = e-s/Rlft*)! 3 *^) 
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( where (p denotes the Fourier transform of (p) is positive definite and 
continuous from 5? into R +; in the Frechet topology. By Minlos' theo- 
rem there exists a uniquely defined probability measure P on the space 
5?' of tempered distributions such that 

F(if)=E P (e«>*>). 

(ii) Furthermore we showed that there is a Gaussian process on 
with the Wiener measure such that 

F( V )=E Wiener (e^). 

From the results of the present paper, we then get 

F{<p) = Eg (e^C®) , 

where Q is the probability measure defined in Lemma \3.1l and where 
the process is constructed in Proposition \4-£\ and Theorem \3.3[ 

In summary, the two Gaussian processes X&)(<p) andWV>((p) have the 
same generating function. 

As a corollary we have: 

Corollary 6.5. Let A = dx denote the Lebesgue measure dx on the real 
line and the Gaussian processes W^(cp) constructed from measures /i 
such that fi << A include the fractional Brownian motion. We get this 
from the choice d/i(x) = ch\x\ 2H dx where H G (0,1) and ch is some 
appropriate constant. 

For some recent work on the fractional Brownian motion, see also [U 

[EIESIEB]. 

7. The probability space (x n R, Q k ) is universal 

Suppose a Gaussian processes is represented in some measure 

space (fl, P), we will then be able to compute the measure P, and 
study how it depends on the initial measure \x on M. This we do in 
Theorem 1 7 . 1 1 b elow . which also yields a measure- isomorphism connect- 
ing P to an infinite-product measure. 

In this section we will show that when (M, /x) is given as above, that 
is, is some fixed sigma-finite measure space, then every realization of 
the corresponding Gaussian process factors through (x^R, Qk)- 
More precisely suppose that is realized as a Gaussian L 2 -process 
in some probability space (fl, J^,P), then there is a factor-mapping 
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setting up to an isomorphism of the respective Gaussian processes on 
(n,3?,P) and on (x n R,Q K ). 

Theorem 7.1. Let (M,S§,n) be fixed, and let the associated process 
(see Definition \2. 1\ and Theorem \3. 3\) be realized in L 2 (f2, J? , P) , where 
(f2, P) is a probability space. Suppose 

(7.1) & = a - alg. Uv^ \AeS§\. 

Then, the following assertions hold: 

(i) For all A G SB with < fi(A) < oo and a,b 6l (with a < b) we 
have 



7i 



(7.2) P (ju; G | a < W { f{uj) < &} 

where 71 zs t/ie standard N(0, 1)-Gaussian. 
(ii) There is a measure isomorphism 

^ : Vt — > x N R 

such that 

(7.3) Por^ Q x and W {Qk '^ o ^ = (fM 

/ioW almost everywhere on £1, and where W^'^ denotes the realization 
ofW^ on (x N R,Q K ) from Section^ 

Proof: Since W [ f G L 2 (ft, J?,P), it follows that every cylinder set 
specified as in (i), i.e., 

ja < Wf < b 

belongs to J£\ since is a Gaussian variable with law N(0,n(A)), 
formula (17.21) from (i) must hold. Now pick an ONB {<Pj}j en in L 2 (/x) 
and, following Theorem \'S.'S\ set 

Zj := W^M, jeN. 

Then, {Zj}. &n is an i.i.d. iV(0, 1) family, and (16.21) holds. Now define 

^ : tt — > x N R 

by 

(7-4) *(u) = {Z j (u)) j&( , 

or equivalently, 

(7.5) 7Tj o * = Vj G N. 
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Applying (I7.5P to the expansion fl6\2|) for WW and for W^ Qk ^\ wc sec 
get 



\y(QK,v) o v|> = yy(p) 



that is, the stochastic process W^ factors as stated. 

Using again ( 16 .2p from Theorem 16.14 we see that 
(7-6) 

* ({a < < &}) C jfoOieN G x N M | a < ■, J^p^d^x) < b 



and that 



= 7a ((a, b\) 

= P ({a < Wj < &}) , 



where we used (I7.2p in the last step of the reasoning. Since JP S is 
generated (as a sigma-algebra)by the cylinder sets, the final assertion 
P o if/ -1 = Q K in (ii) follows. We do this by passing from monic sub- 
sets ja < W^ < b\, to finite functions, and to measurable functions 
by inductive limit. 

A function F on (Q, is said to be finite if there is n £ Z+, a bounded 
]R n -Borel function f n , and A\, . . . , A n £ 3$ such that 



(7.7) 
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With F as in ( 17. 7p . we then have 

E P (F)= / f n (Wjg(u), • ■ ■ , W^(u))dP(u) 

f n {Xi, X21 • • • , X n ) X 



n 



x 1aA x i)1a 2 {x2 ~ a;i) ■ ' ' 7a„ (^n - a; n _i)(ixi(ix 2 ■ ■ ■ dx n 

fn(Vl, 2/1 + 2/2, - - - , 2/1 + 2/2 H h 2/n) x 



x 7Ai (2/i)7a 2 (2/2) • • ■ lA n (yn)dyidy 2 ■ ■ ■ dy n 

J fn{Wf^\---Wf n K ^)dQ K 
[ fn(W^ r --WM)d(Qo*) 

Jn 

Eq x o* (F) ■ 

□ 



Corollary 7.2. Fix (M,£$,/j) as in Theorems \6.1\ and 7.1 , and denote 



by the set of all finitely additive functions u> : SS — > R. Set 
(7.8) W A {u) = u(A), MA e 

and let {Zj}j eN be the corresponding i.i.d. N(0, 1) system from Theo- 
rem \6.1\ (The measure P on ojgg is from ( I7.3P in Theorem \7.1\ i.e. 

where \1/ zs (jwen fry (17.41) . t/iat zs, ^(u) = {Zj{oj))- m , Wu G 38). For 
£ = (O)ieN £ s' ; and Ae^, set 



(7.9) 



00 „ 
j= i J A 



Then, 

ii) r(0 e 

(ii) *(r(0) = £, V£es', 

and 

(m) P ({to e n a , I r (*(w)) = w}) = 1 
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ifj(x)dn(x) J Zj(uj 



A 



Proof: The asserted conclusions follow from Theorem 16.11 and 17.11 

Note that (Hi) in the Corollary says that 

(7.10) ro^ = Id^, a.e. 
where P^ is the measure on given by 

(7.11) ?/^I> 1 Q K . 

Now, formula ( 16.1 ft is an identity in L 2 (fi,^,P^). Since 

wf ) (w)=u(A), VweQj, 
we get the following P.^-a.e. identity holding on 
u(A) = wf\u) 

oo 

= E 

= ((rof)( u ))(4 vag^. 

This proves ( 17.1 Oft . □ 

Corollary 7.3. Let * : — ► I1n k &e as ^ n dZ3J), awe? de/me 
i/ie induced operator A from the bounded Borel function defined on 
Y[ N R iwio £/&e bounded Borel function defined on Q, 

Af = / o 

Then, A is a Markov operator (see ^0\), i.e. the following properties 
hold: 

(i) f > a.e. A/ > 0, a.e., 

(ii) Al = 1, 

(iii) A*l = 1. 

Proof: Note that in (ii) and (Hi) the symbol 1 denote the constant 
function equal to 1 in the respective measured spaces. Properties (i) 
and (ii) are clear. For (Hi) we use the fact that functions of the form 

^(0 = /«(&,•••,&)• 

where f n is a bounded Borel function on R" are L 2 dense. For such a 
function, we want to check that 

E Qk (F(1-A*1)) = 0, 
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or, equivalently, 

E p (A(F))=E Qt (F). 

We have 

E P {A{F))=E{f n {Z l {-),...,Z n {-)) 



fny^Xt ■ ■ ■ i •En)'~1n i • • • j X n jd,X^ • • • dx n 



= ® Qk (F), 

where we have used the properties from Theorem 17. II for the respective 
measures P and Qk, as well as the i.i.d. system (Zj) . gN from (16.21) in 
Theorem 16. 1[ □ 



Corollary 7.4. Le£ (M,^,fj), £L& and P := Pjp fre as in Corollary 
\7J% Set on£gx£g 

(7.12) K(A,B) = e(^-"^ im ). 

Then we may define a Fourier transform F i— )■ F /rom L 2 (f2,^,P) onto 
i/ie reproducing kernel Hilbert space T-L{K) with reproducing kernel K 
as in (171211 . For F E L 2 (tt,%, P), 

(7.13) F(A) = E (F(-)e^ M)() ) , Ael 

Moreover the map F ^ F is an isometric isomorphism between the 
two Hilbert spaces. 

Proof: We begin with finite sums of the form YljeJ a 3-^ A ^ where the 
\ j are real, Aj e SS and \J\ < oo. Comparing the Hilbert norms we 



a 

have 



jeJ j,keJ 

= a 3 a k e-^ XA ^ XA ^) 



j,keJ 



£ aja k E (e iW ^e-^) 



where we have used Theorem 13.31 (see in particular (13.141) ) in the last 
step in the computation. This complete the proof of the isometry since 
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such finite sums are dense in T-L(K). Completing by taking T-t(K)-norm 
closure, we see that the adjoint of the map J(F) = F is isometric from 
U(K) into L 2 (fi«,P). Indeed, 

(7.14) J ( e iW t ') =K A eU(K), 
and 

(7.15) J*{K A ) = e m *\ Ae£g. 
It remains to prove that 

{e™? | A g i 

span a dense subspace in L 2 (fL^, P), and if F G L 2 (fL^, P) is such that 

(7.16) F(A) = E (f^ w a^ =0, \/A G ^, 
then F = 0. 

To verify this, we may use the known representation of L 2 (fi$g,P) as 
the symmetric Fock space over L 2 (<i/i); see [20]. We also make use of 
Theorem 17.11 above. Suppose F G L 2 (fi^,P) satisfies (I7.16p . In the 
Fock-space representation, 

oo 

(7.17) F = Y,F n 

n=0 

is referring to Wiener chaos expansion of F, that is, the orthogonal de- 
composition of F along the orthogonal sum of all symmetric n-tensors, 
as n = 0,1, 2,..., and with n = referring to the vacuum vector. See 
also [llj. Substitution of (17.171) into (I7.16P yields 
(7.18) 

/ \ 



E 



F n W ( f X • • • X W { f 

V v ' 



= 0, V7L G 3S, and n = 0, 1, . . . 

\ n times / 

Using now the Ito-integral from Proposition 14.21 equation (17.181) may 
be rewritten as 

r F n {x u x 2 , x n )dWg>dWV> ■ ■ ■ dW<£ = 0, 




A J A 



n times 

that is (and where <g> denotes the symmetric tensor product), 
(7.19) F n 1 ® n lXA , VAe^g. 
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Since F n E ®"L 2 (/i) is a symmetric tensor, we conclude from (17.191) 
that F n = 0. This holds for n = 0, 1, . . . and so by (17371) . F = 0. □ 



Remark 7.5. T/ie /ac£ i/iai B) is positive definite on 3$ can he 
checked also as follows: The function 

(A U\ (An m , ll{A)+n{B) 

n(A, B) = -fi(A nB) + 

is conditionally negative on SS , and therefore the function e~ n ^ A,B " 1 is 
positive definite there. See p2] for the latter. 

8. Iterated function systems 

The purpose of the present section is to give an application of the 
theorems from Sections M and [7J to iterated function systems (IFS), 
see e.g. ^Sj- Such IFSs arise in geometric measure theory, in har- 
monic analysis, and in the study of dynamics of iterated substitutions 
with rational functions (on Riemann surfaces); hence the name iter- 
ated function system. With an IFS, we have the initial measure space 
M and a Borel sigma-algebra 3$, coming with an additional structure, 
a system of measurable endomorphisms. We will be interested in those 
measures /i on M which satisfy suitable self-similarity properties with 
respect to the prescribed endomorphisms in M. For background, see 
e.g. [27l[2BJ[2H]. 

Given a measure space (M, 3§) as in Section [21 i.e. SS is a fixed Borel 
sigma-algebra of subsets of M, by an iterated function system (IFS), 
we mean a system of endomorphisms (Tj)i e 7 

t, : M — > M, 

each Tj assumed measurable and the index set I usually finite. 

If a family of measures fi on S$ is specified, each Tj is defined a.e.. 
Typically, M will be a locally compact Hausdorff space, and we assume 
that each r, is continuous. The following restrictions will be placed on 
the family (rj) ie/ : 

(8.1) Ti(M) n Tj(M) = 0, Vi, j e I (non-overlapping), 



1.2) \Jr l (M) = M, 



{cover), 

■iei 

and there is a measurable endomorphism R from M into M such that 
(8.3) R o n = ld M , Vi G /. 
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We say that the family {rj} ig/ is a system of branches of an inverse to 
R. This is in particular the case in applications to Riemann surfaces, 
where R is typically a rational function. 

In view of the following definition, recall that we have defined (fi) in 
Definition 15.11 

Definition 8.1. Let {M,0§) be fixed, and let M' denote the corre- 
sponding Hilbert space of sigma- functions; see Definition 4-F and let 
fi G {M,3§). If R : M — > M is a measurable endomorphism, we 
consider the measure fi o R" 1 , i.e. 

(8.4) (jjtoEr 1 )(A)=n(ir 1 (A)), VAGJ, 
where 

R-\A) = {x G M | R(x) G A}. 

We set 

(8.5) (H o R) (fi) = {(/ o R) y/djl | / G L 2 (/i o iT 1 )} . 

Definition 8.2. Let fi G {M,&), and let {r;} ig/ be as in (1Q)- ([8"3]1 in 

the previous definition. We say that (//, {rj} ig/ ) is an iterative function 
system (IFS) if 

(8.6) fi o rr 1 « ft, Vz G J. 
yln IFS is said to be closed if 

(8.7) y d(HQTr 1 ) = h 

Note that the Radon-Nikodym derivatives in the summation (17. 2ft are 
well defined on account of (18.61) . 

Remark 8.3. Special cases of IFS have been widely studied in the 
literature; see e.g. [23 [281 1221 M, S2J SD HZ] • 

In these examples, the Radon-Nikodym derivatives d ^° r » — - in (18 ,7p are 
constant functions, say 

d(fio T r l ) 



Pi, i G /, 



dfi 

and Ylii^iPi = 1) so that i n particular pj G (0,1). As further special 
cases of this, we have the Cantor measures: For example, let M be the 
usual middle third Cantor set, and define two endomorphisms 

T o( x ) = |> and T i(x) = ^y^- 
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Then, there is a unique probability measure /x supported on M such 
that 

(8.8) fj, = - (fi o Tq" 1 + fi o rr 1 ) . 

This is an IFS, and p — p% = |; compare with (j8.7p . The scaling 
dimension of \x is log 3 (2) = 

Lemma 8.4. Let (//, {Tj} ie/ ) zs an iterative junction system. Then for 
each i E I the mapping 

(8.9) (/,<*//) m- (foR^orr 1 ) 

induces (by passing to equivalence classes) an isometry from into 
{HoR){ror^). 

Proof: In principle there are issues with passing the transformation 
onto equivalence classes, but this can be dome via an application of 
Lemma I4T31 Hence in studying (I8.9p . the question reduces to checking 
instead that the application 

(8.10) W M (f) h-> W^ OT ^\foR) 
is isometric. Indeed, 

E(\W^(f)\ 2 )= [ \f(x)\ 2 d^x) 

J M 

= [ (\foRo Ti (x)\ 2 )dfi(x) 

J M 

= j (\{foR){x)\ 2 )d^or^){x) 

J M 

= Eq(|H/^ 1 ) (/0j R)| 2 ), 
which is the desired conclusion. □ 

We now turn to representation of the Cuntz relations; see e.g. [131 
[28]. 

Theorem 8.5. Let (//, {Tj} ig/ ) is a closed iterated function system, and 
set gi = -^-j^ — - (see ( 18. 6 p and (18 .7p ). Then the operators 

(8.11) S t (f)=Xn(M)V9^foR), i el, 

define a representation of the Cuntz algebra Oj (with index set I), 
acting on the Hilbert space L 2 (/i) ; i.e. as isometries in L 2 (/i), the 
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operators Si from ( 18. lip satisfy: 

(8.12) S:Sj = Sijldu^ViJel, 

(8.13) J2 S * S * = ld ^y 

iei 

Proof: Condition (18.12p is immediate from the preceding lemma. Now 
fix i G I. one checks that the L 2 (/x)-adjoint of the operator in (18.111) is 

(8.14) S*ip = <po Ti , V^GL 2 (/i), Vie J. 

We are now ready to verify (I8.13p . i.e. the second Cuntz relation. In 
this computation we make use of (18.71) . i.e. 

iei 

For ip G L 2 (/i), we have: 

\ip(x)\ 2 dfi(x) = Y] I \ip(x)\ 2 gi(x)dn(x 



M 



iei 

iei Jm 

= £ / T t\ 2 {x)dn{x) 
iei Jm 

= E / i^r^)^^) 

iei Jm 
= ^2(v,SiS*f) L 2 M . 

iei 

Since this holds for all (p G L 2 (aO the desired formula (I8.13P has been 
verified. □ 



9. Gaussian versus non-Gaussian 

In this section we show that the theory, developed above, initially for 
Gaussian Hilbert spaces, applies to some non-Gaussian cases; for ex- 
ample to those arising in the study of random functions. To make 
this point specific, we address such a problem for the special case of a 
concrete random power series, studied as a family of infinite Bernoulli 
convolutions on the real line. We know, see [ID], that every positive 
definite function may be realized in a Gaussian Hilbert space. Our re- 
sults in Sections HH3] are making this precise in some settings dictated 
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by applications to stochastic integration. 



Definition 9.1. If T is a set, then the function 

(9.1) C : TxT — > C 

is said to be positive semi- definite (p.s.d) (we will also say positive 
definite) if for every finite subset S C T , and every family {a s } s£S C 
C' 5 ', we have 

(9.2) cr s a t C(s,t)>0. 

( s ,t)eSxS 

A Gaussian representation of a p.s.d function consists of a Hilbert space 
"H and a function 

X : T — > H 

such that 

(9.3) C(s,t) = (X s ,X t ) n , Vt,seT, 

such that, for all t e T, X t is a Gaussian random variable with zero 
mean, E(JQ) = 0, and moreover 

(9.4) E(X* s X t ) = C(s,t). 

The following is an important example of a solution to the problem 
fl9.2l) - fl9.4p . when the Gaussian restriction is relaxed. In its simplest 
form, it may be presented as follows: 

Proposition 9.2. Let T = (0, 1) and consider the function 
C : (0,1) x (0,1) — ► M + 

defined by 

(9.5) C(X,p) = I ^-. 

There is a solution to the representation problem (19. 3 p in a binary prob- 
ability space Q(2) = x N {±l} with the infinite coin-tossing probability 
product measure 

g:=x N (-,-). 

Proof: We will be making use of facts on Bernoulli convolutions. For 
some of the fundamentals in the theory of Bernoulli convolutions, we 
refer to [291 EJ H2] . We consider on f2(2) the system {efc} feeN of random 
variables 

e fc ((uj) jeN ) = u k , Mk e N. 
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Denoting the expectation with respect to q by E 9 (-) we have 

(9.6) E ff (e fc ) = 0, and E 9 ( ei e fe ) = 5,-, fe , Vj, k G N. 

The system {efc} fc6N is therefore i.i.d., but non-Gaussian. For A G (0, 1), 

set 

oo 

(9.7) X x {u) = £k{ui)\ k , Vw G tt(2). 

k=l 

Such an expression is called a random power series. Then the distribu- 
tion 

(9.8) /i A = goX A -\ 

(i.e. H\{A) = q(X^ 1 (A)) for all Borel subsets A of fi(2)) is the infinite 
Bernoulli convolution measure given by its Fourier transform 



(9.9) //(£) = n cos (2ttA"£) , V£ 



G E. 



n=l 



Equivalently, if r±(x) = A(x± 1), the /x A is the unique measure defined 
on the Borel sigma-algebra £§ of R by 

(9.10) /i A = ^ (a*a o T+ 1 + A*A o rr 1 ) , 

see also ( I8.8p . Note that for every A G (0,1), \i x has compact sup- 
port strictly contained in the open interval (—1, 1). We now verify the 
covariance property 

(9.11) E q (X x X p ) = T ^-, VA, pG (0,1). 

In the left hand-side of (19. lip we substitute (19. 7p . and we make use of 
the i.i.d. properties (19. 6p . Then 

k feJfe X P 



□ 



Theorem 9.3. (Peres- Schlag-Solomyak and Peres-Solomyak, jHJHSjj 
T/iere is a Borel function 

D : [i l)x(-M) — ► M+ 
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such that the following properties hold for all f G C c f[|, 1) x (—1, 1)) ; 
(z) T/ie integral 



/(A, x)dfi\(x)d\ 

'[i,l)x(-l,l) 

zs we// defined, where dX denotes the standard Lebesgue measure re- 
stricted to [|, 1), 
and 

/(A, x)dfj,\(x)d\ = // /(A, x)D(X, x)dxdX. 

|,i)x(-i,i) Mil)* (-1,1) 

We first present some corollaries of this result. 

Definition 9.4. Set 

(9.12) 

AC2 = { A G [-,1) I the Radon- Nikodym derivative G L 2 (dx) 
i 2 dec 

(Note that the existence is part of the definition). 

Remark 9.5. The theorem asserts that AC2 has Lebesgue measure 
equal to 1/2, i.e. H\ is singular only on a subset of [~, 1) of measure 

zero. By a result of Erdos (see [IE]j> when X = g _1 where g = v ^ +1 
is the Golden ratio,, then fix is singular. Otherwise it is absolutely 
continuous on a subset in 1) of full measure. 

Corollary 9.6. For a number X G [|, 1), the following conditions are 

equivalent: 

(i) The function 



t i-> JJcos(A n t), te 



n=l 

belongs to L 2 (M, dx). 
(ii) We have 

liminf — u\ (\x — r, x + x]) < 00 
rio 2r 

for a. a. 16 M. In this case, we may take 

(9.13) D(X,x) = liminf —fi X ([x-r,x + x]) G L 2 ((-l, 1), dx) 

rio 2r 

in fl9TT2|) . 
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Corollary 9.7. The points A G AC2 correspond to a single equivalence 
class in the Hilbert space T-L of Definition \4-l\ If Xi and A 2 belong to 
AC2, we have 

(9.14) (/1 a/ dfj-xt , h V dn\ 2 )n = / f 1 {x)f 2 {x)y/D{X u x)D(X 2 , x)dx, 



where dx is the Lebesgue measure. 

Proof: Using flDTTUj) 
(9.15) 

(p(x)d/j,\(x) = - ( / ip(\{x + l))dn\(x) + I ip(X(x - l))dii\{x] 



2 

and a recursive iteration leads to the representation 



fi^t) = e itx dnx(x) 
Jr 

(9.16) =E g (e"^) 

00 

= JJcos(A"t), 

n=l 

with the right hand-side of (19.161) converging point-wise for all t G R. 
If A G AC 2 , then 

D(X,x) = L 2 (-l,l) C L 2 (R), 

ax 

and substitution into (I9.16P yields 

= / e- Ux D(X,x)dx, 
Jr 

and by the L 2 (R, (ix)-Fourier inversion, 

/CO 
e iix JJ cos(X n t)dt 
n=l 

for 1,1). Hence, Plancherel's equality leads to 

|D(A,x)| 2 dx = / JTcos 2 (A n t)c/t < 00. 

We now turn to (19. 14[) . If Ai,A2 G AC2, then both fi\ t and ma x are 
absolutely continuous with respect to Lebesgue measure, and by (14.31) 

35 



we get 

(fiy/dfiXi, fry/dnx^n = J fi {x)f 2 (x)\J (x) (x)dx 

= J fi(x)f 2 (x)^D(X 1 ,x)D(X 2 ,x)dx. 

□ 

We showed that, when A is given in AC2, then the corresponding 
Bernoulli measure fi X satisfies the Bernoulli scaling law. But for A 
fixed in AC2, this then turns into a scaling identity for the L 2 Radon- 
Nikodym derivative, a variant of the scaling law studied in wavelet 
theory, but so far only for rational values of A. This fact is isolated 
in the corollary below. It is of interest since there is very little known 
about L 2 solutions to scaling identity for non-rational values of A. For 
the literature on this we cite [13j [HI [15j [50] . 

Corollary 9.8. Let (/xa)a£(o,i) be the Bernoulli measures. For X G 
AC 2; let D(X, ■) = dfl ^ be the Radon- Nikodym derivative. Extend 
D(X,x) to x G R. by setting it to be equal to zero in the complement of 
(—1,1). Then, 

D x (-) = D(X,-)eL\(R), [ D(X,x)dx = l, 

and 

(9.17) D x (Xx) = l - (D x (x + 1) + D x (x - 1)) 

for a. a. x with respect to the Lebesgue measure on R. 

Proof: From the definition of AC2 we know that the Radon-Nikodym 
derivative x ^ D(X,x) exists, and that D(X, •) G L\(R) D L 2 (M). Us- 
ing (I9.15p - (l9.16p above, we conclude that f R D(X,x)dx = 1. □ 

Remark 9.9. Note that for X — \, equation (19. 17|) reduces to the 
standard scaling identity for the Haar wavelet system in L 2 (IR, dx). In 
wavelet theory, the scaling identity is considered for N G Z + , N > 1, as 
follows: Given N, one studies solutions if G L 2 (IR, dx) to the scaling- 
rule 

kez 

where (ak)k&z is square summable. 
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Before giving the proof of Theorem 19.31 we need preliminary lemmas: 
Lemma 9.10. 

(i) If X G (0,7;), the measure p x is singular with respect to Lebesgue 
measure, with scaling dimension D s = — pf , o,nd the IFS defined by 
x i — y X(x ± 1) is "n on- overlapping" . 

(ii) If X = ~, then p x is equal to the Lebesgue measure restricted to 
[-1,1]- 

(Hi) For almost all X in [|, 1), the measure dp x is absolutely continuous 
with respect to dx, with Radon-Nikodym derivative 

^( x ) = D(X,x)eV(-l,l). 

dx 

Proof: The first two assertion are in the literature, and (Hi) is from 
[12] . It is our aim in Theorem 19.31 to give an independent proof in the 
reproducing kernel (19.51) restricted to [|, 1) x [|, 1); see also Proposition 
EJ and equation <^M>. " □ 

Our purpose in connection with Theorem l9.3l is as follows: The proof of 
the result in [42J relies on the following estimate on X\ for a subset of 
points A G (|, 1), defined for measurable functions F on (x N {±1}) x 
(x N {±1}), estimating expectations 

(9.18) E qxq ((l(S)X x -X x (S) 1)F) 

where 1 is the constant function 1 on Xpj{±l}. 

One is in particular interested in (I9.18P in functions F of the form 

(9-19) Ft — X{(u,u)') such that \X x (ui)-X x (uj')\<r} , 

where r > 0. 

For subintervals J of (|, 1) one must find estimate on 

E qxq (F r )dX 

In accomplishing this, the following three lemmas below are helpful. 

Lemma 9.11. LetFL be the reproducing kernel Hilbert space from ( 19.51) . 
with A, p G [|, 1), and set 

k x (p) = Y ^- p = (k x ,k p } n , VA, P G[i,l). 
Then the assignment 



(9.20) k x EJf ^ X x (-) GL 2 (x N {±l},g) 
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extends to a Hilbert space isometry ofTi into L 2 (x N {±1} , q). 

Proof: The conclusion follows from the basic axioms of reproducing 
kernel Hilbert spaces once we verify that 



(9.21) (k x ,k p ) n = / X x (io)X p (u)dq(u) } 

'xn{±1} 



equation (19. 3 P from the computation 

Xp_ 
1 - Xp 

by □ 



(k x ,k p ) H = -^- = E q (X x X p ), 



Definition 9.12. We denote by H 2 (D) the Hardy space of the open unit 
disk of functions analytic in the open unit disk D = {z G C | \z\ < 1} 
represented as 

oo oo 

(9.22) f(z) = a n z n , l a «! 2 < °°' 

n=0 n=0 

and norm ||/||h2( B ) = X^=o l a «| 2 ' and set 

H 2 (D) = {fe H 2 (D) | f(0) = 0} . 

Lemma 9.13. The reproducing kernel Hilbert space H from (19. 5p is 
isometrically equal to Hq(D) via the map 

oo 

(9.23) k x e H ^ k x {z) = e H 2 (D). 

n=l 

Proof: It is immediate from the definition that the map k\ i— > k\ in 
(I9.23P extends to an isometry 

J : H — > H 2 (D). 

We claim that it is onto: ran (J) = Hq(D). Indeed, since J is isometric, 
ran J is closed, now, if / G Hq(D) ran J, then 

/(A) = (/,^) H g(D) = 0,VAG[i,l). 

Since / is analytic in D and [|, 1) C ED, we conclude that / = 0, and 
therefore ran (J) = Hq(D) as claimed. □ 
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We now comment on the use of Lemmas 19.111 and 19.131 About (19.181) 
the estimate 



See Proposition 19.21 and Lemma 19.111 

As for estimating (19.191) . we make use of the Hardy space represen- 
tation in Lemma 19.131 Under the isometry in (I9.2ip the difference 
\Xx(oo) — X\(oj') | with uji = uj\ for i = 1,2, ... ,k may be estimated in 
the subspace z^H^D),, i.e. functions in H 2 (D) vanishing at to order 



10. Boundaries of positive definite functions 

In this section we apply our results from Sections |3] and [7| into a gen- 
eral boundary analysis for an arbitrarily given non-degenerate posi- 
tive definition function (Definition 19. ip . While it is known that every 
non-degenerate positive definite function admits a Gaussian represen- 
tation, our construction here offers such a representation in a form of a 
boundary in a sense which naturally generalizes boundaries in classical 
analysis, for example generalizing the known boundary analysis for the 
Szego kernel of the disk. Again we stress that our starting point now 
is an arbitrary fixed non-degenerate positive definite function C, but 
C is on T x T where T may be any set, continuous or discrete. For 
example T may represent the vertices in some infinite graph, and C 
may be some associated energy form of the graph G, induced by an 
electric network of G; see e.g., [TO EI]- A second recent application 
of reproducing kernels and their RKHSs, is the theory of (supervised) 
learning; see e.g., [351 EHl EE]- The problem there is a prediction of 
outputs based on observed samples; and for this the kernel enters in 
representations of samples. 

Among the applications of stochastic processes, the theory of "bound- 
aries" is noteworthy. Common to these is the need for representations 
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of functions on some set, say T, as integrals over some measure bound- 
ary space arising as a limiting operation derived from the points in the 
initial set T. As example of this is the Hardy space H 2 (D) (see Defi- 
nition HH2]), which is the reproducing kernel Hilbert space with kernel 
the Szego kernel 

(10.1) C(z,w) = -^—^, z,weB. 

1 — zw* 

If (•) ')h 2 (d) is the inner product of H 2 (D) we have 

(10.2) /WH/.^W), /GH 2 (D), weB. 
In this example we have 

i i r i i 

(10.3) = — / — —r —AQ- 

K ' 1 - zw* 2tt J_ w 1 - ze~ ie 1 - w*e ld 

Now recall that the general case of positive definite functions C on 
an arbitrary set T, as in Definition 19.11 offers a generalization of the 
classical theory of the Hardy space recalled above. In this general 
case, the aim is to provide a Gaussian measure space associated to an 
arbitrary given positive definite function 

(10.4) C : TxT — ► C. 

This measure space will be denoted by bdr c (T), and it should be offer 
a direct integral representation for (110. 4p naturally generalizing ( 110. 3p . 
where the boundary of D from (110.31) is the circle {z 6 C |, \z\ = 1}. 

Definition 10.1. We say that a positive definite function C on a set 
T is non- degenerate if the following two conditions are satisfied: 

(0 

dim U{C) = N„, 

where H(C) is the reproducing kernel Hilbert space associated to C . 
(ii) The following implication holds: 

C(s,ti) = C(s,t 2 ), VsGT t 1= t 2 . 

Theorem 10.2. Let C : T x T — > C be a non- degenerate posi- 
tive definite function where T is some fixed set. Let s' be the sequence 
space introduced in Lemma [XT1 (see equation (13.21) ). Then there is a 
weak* -closed subspace bdrc(T') c s' ; a Gaussian measure Pc defined 
on the cylinder sigma-algebra in bdrc(T), and a Gaussian process X : 

(10.5) X t : bdr c (T) — > C, teT, 
such that (i) we have 

(10.6) C(s,t)= [ X a (£)*X t (Z)dPc(£), Vs, teT, 

Jbdr c (T) 
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and, (ii) (bdr^T), Pc, X t ) is a minimal solution to (i). 

Proof: Let be an orthonormal basis in %{C). It is well known 

that 

oo 

(10.7) C(t,s) = J2w(t)w(s)*, Vt,sGT, 

3=1 

and 

oo 

(10.8) £|^(t)| 2 = C(t,t)<oo. 

Now define r : T — ► £ 2 C s' by 

(10.9) r(t) = (^-(t)). eN , t £ T. 

We claim that r is one-to-one, and as result, we may identify points 
t G T with their image in s'. Indeed, let ti,t 2 G T and suppose that 
t(*i) = r(t 2 )- Then, 

oo oo 

i=i j=i 
and in view of condition (ii) in Definition 1 1 . 1 1 we conclude that t\ =t%. 

Set t(T) = {r(£) | t G T}, and set cloc(T) its closure in s'. Here, 
by closure we mean the weak*-topology in s' defined by the duality 
between s and s'. The neighborhoods for this topology are generated 
by the cylinder sets introduced in f)3.3p . Finally, set 

(10.10) bdr c (T) = clo c (T)\r(T). 
Now, following Lemma [3. 1\ set for £ G bdrc(T) 

oo oo 

(10.11) x t (o = 52{<p s (t)y*s(t) = E&foWr. 

3=1 3=1 

the "random" function associated with the choice {<Pj} of ONB in 
%{C). Note that if £ in (jlO.lip is "deterministic", i.e., if there is a 
s G T such that 

^•(0=6 = Vj'GN, 

then 

oo 

(10.12) •Xt(0 = ^Vi(a)(Vi(*))* = C r (*.s). VtGT. 

i=i 
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Now, define by F c the measure on bdrc(T) induced by Q on s', as in 
Theorem 17. 11 We get 

E Po (X t (.)X s (.)*) = E Po ^f>(sKj (X>W*^ 

oo 

i=i 

= C(t,s), W,sGT, 

whence the desired conclusion (110. 6p in part (z) of the theorem. The 
other conclusion (ii) follows form the assignment ( 110. 10p in the defini- 
tion of bdr c (T). □ 



Application 10.3. Our boundary construction applies to electrical 
networks as follows (see [30] ). 

An electrical network is an infinite graph (V, E,c) , V for vertices, 
and E for edges, where c is a positive function on E , representing 
conductance. As sketched in [SU], we get a reproducing kernel Hilbert 
space from the energy form of (V,E,c). In [5U], the authors propose 
one boundary construction, and one can verify that the one from our 
present Theorem \lU.^\ applied to H is a refinement. 

Remark 10.4. Our construction o/bdrc(T) depends on the choice of 
ONB in (110.7p . but the arguments in the proof in Theorem \10.S\ above) 
show that two choices of ONB and {^fcjfceN yields the same 

bdrc(T) if and only if there is an infinite unitary matrix (^,jfc)(j,fc)eN 2 
such that 

feeN 

and the following equivalence holds: 

(ii) (bj)jeN G s (cj)jeN e s, with cj = ^ U jtk b k . 

ken 

In other words, the matrix- operation defined from U preserves the se- 
quence space s of (13. ip . 

Example 10.5. Consider now the Hardy space H 2 (D) (see Definition 
\9.1ty) . On may check that, with the choice of the standard ONB in 
H 2 (©) 

if k (z) = z k , k G N := {0} U N, z G D, 
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we get 

bdr Szeg6= {( e ^) fceN() I *e 

which by identification yields (tt, it], which is consistent with (110.31) 
above. 

Example 10.6. (see [4\). Here the pair (C,T) from Definition ! 10.1\ is 
as follows: Consider the rational function R(z) given by 

R{z) = z 4 - 2z 2 , zeC. 

Set Ro(z) = z, R\[z) = R(z) and 

RJz) = (RoRo---oR)(z). 

n times 

Now set 

T = = {zeC such that (R n (z)) ne ^ G f 1 } , 
(where N o = NU{0}J and on Q x Q set 

oo 

C(z,w) = H(l + R n (z)R n (wy). 

n=0 

Using the ideas of Exemple 1 1 . 5 1 and from [1] we note that for this (C, T) 
we get that c\oc{T) is the filled Julia set of R. See also citeMR1128089 
for basic properties of Julia sets derived from fixed rational functions 
of a single complex variable. 

Definition 10.7. Let (C,T) be as in Definition MO. 1[ Following [38] , 
we say that C is a Mercer-kernel if: 

(i) T is a compact metric space (with respect to some metric, say d), 
and 

(ii) The function 

C : T x T — ► C 
is continuous with respect to d x d. 

Proposition 10.8. If (C,T) is a Mercer kernel, then cloc(T) = r(T); 
in other words r(T) from (I10.9p is closed. 

Proof: Let £ G s', and let (tfc)fceN be a sequence of points of T such 
that lim^oo r(tfc) = £; see the discussion before Lemma |3~T1 Using 
(i) in Definition 110.71 we may, without loss of generality, assume that 
the sequence (tk)ken is convergent in T, i.e. limfc^oo d(t, tk) = where 
t G T is its limit point. 
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Let {(Pk}j£jn be an ONB in H(C), see (110. 7p in the proof of Theorem 
HO Then, 

oo 

Mt) - r(t k )\\l = J2Mt) - ^(tk)\ 2 

3=1 

= C(t,t)-2ReC(t k ,t) + C(t k ,t k ), 
where we have used (I10.7I) - (I10.9I) in this computation. 

By virtue of Condition (ii) in Definition 110.71 we now note that the 
right hand-side in the last term converges to zero as k — > oo. But 
convergence in £ 2 of the sequence (r(t k )) k&fi implies convergence in s'. 
We conclude that r(t) = £, and so r(T) is closed in s'. □ 



Example 10.9. Let T = I = [0, 1] be the closed unit interval, and set 

C(t,s) = tAs, t,sel. 

Set 



(10.13) <p k (t) : 



V2^^, keN, 
t, k = 0. 



Then: 

(i) r{t) := (<^ fc (t)) fceNo satisfies 

(10.14) \\r(t)-T( 8 )\\l = \t-8\, t 7 se [0,1]. 

(ii) T/ie map t i-> r(t) is an homeomorphism from I onto a closed 
curve starting at Vq = (0, 0, 0, . . .) and with endpoint v± = (1, 0, 0, . . .) 



m £ 2 . 



(Hi) The curve in (ii) has no self-intersection. 

Proof of the claims in Exemple 110. 9t The conclusions are imme- 
diate from Proposition 110.81 Indeed, the reproducing kernel Hilbert 
space associated to C is 

(10.15) U = {/ G L 2 (J) | /' G L 2 (J) and f(0) = 0} , 

and one easily checks that the function system (v ? fc)fceNo ^ s an orthonor- 
mal basis in %. Indeed, for j, k G N, 

((fj,(p k ) n = 2 / cos(j7ra;) cos(knx)dx = 5j ik . 
Jo 

The assertions follow then from Proposition 110.81 In this example the 
Gaussian process from (110.111) associated with (C, I) is the Brownian 
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motion. Hence 



(10.16) \\r(t)-r(s)\\l = E(\X t -X s \ 2 ) = \t-s\, t,sel, 

which is (i), and also leads to (ii) since r is one-to-one and contin- 
uous between two compact spaces, and so is an homeomorphism. To 
justify ( llO.lfip note that the Hilbert norm in U is \ ff H = £ \f(x)\ 2 dx. 

Setting 



we get 



and 




CAx) 



(C t ,C s ) H = I X[o,t}{x)X[o,B){x)dx 



t A s 
C(t,s) 



. . 2 ^ s'm(kTct) sin(/c7rs) 
C {t, s) = ts + — ^ p • 

fc=l 

Finally, if there exist t± and ^2 i n (0, 1) such that r(ti) = T(t 2 ), then 
C(t,ti) = C(t,t 2 ) which is not possible unless t\ = t 2 . □ 
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